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Abstract 


Fractal  and  fractal-rate  stochastic  point  processes  (FSPPs  and  FRSPPs)  provide  useful  mod¬ 
els  for  describing  a  broad  range  of  diverse  phenomena,  including  electron  transport  in  amor¬ 
phous  semiconductors,  computer-network  traffic,  noise  in  CCD  images,  and  sequences  of 
neuronal  action  potentials.  A  particularly  useful  statistic  of  these  processes  is  the  fractal 
exponent  a,  which  may  be  estimated  for  any  FSPP  or  FRSPP  by  using  a  variety  of  statistical 
methods.  Simulated  FSPPs  and  FRSPPs  consistently  exhibit  bias  in  this  fractal  exponent, 
however,  rendering  the  study  and  analysis  of  these  processes  non-trivial.  We  have  examined 
the  synthesis  and  estimation  of  FRSPPs  by  carrying  out  a  systematic  series  of  simulations 
for  several  different  types  of  FRSPP  over  a  range  of  design  values  for  a.  The  discrepancy 
between  the  desired  and  achieved  values  of  a  has  been  found  to  arise  from  finite  data  size 
and  from  the  character  of  the  point-process  generation  mechanism.  In  the  context  of  point- 
process  simulation,  reduction  of  this  discrepancy  requires  generating  data  sets  with  either 
a  large  number  of  points,  or  with  low  jitter  in  the  generation  of  the  points.  In  the  context 
of  fractal  data  analysis,  the  results  presented  here  suggest  caution  when  interpreting  fractal 
exponents  estimated  from  experimental  data  sets. 
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1  INTRODUCTION 


Some  random  phenomena  occur  at  discrete  times  or  locations,  with  the  individual  events 
largely  identical.  A  stochastic  point  process  [1]  is  a  mathematical  construction  which  rep¬ 
resents  these  events  as  random  points  in  a  space.  Fractal  stochastic  point  processes  exhibit 
scaling  in  all  statistics  generally  considered;  fractal-rate  stochastic  point  processes  do  so  only 
in  some  of  them.  We  have  considered  the  simulation  and  estimation  of  fractal  and  fractal- 
rate  stochastic  point  processes  on  a  line,  which  model  a  variety  of  observed  phenomena  in  the 
physical  and  biological  sciences.  It  comprises  an  effort  we  first  began  in  1993  [2],  reported 
on  in  1995  [3],  and  concluded  in  1997  [4]. 


2  ESTIMATION  OF  THE  ALLAN  FACTOR  AND 
POWER  SPECTRAL  DENSITY 


Given  a  segment  of  an  FRSPP,  we  seek  an  estimate  a  of  the  true  fractal  exponent  a  of  the 
entire  process  from  which  the  segment  was  derived.  Several  effects  contribute  to  estimation 
error  for  finite-length  segments,  regardless  of  the  method  used.  The  fractal  exponent  provides 
a  measure  of  the  relative  strengths  of  fluctuations  over  various  time  scales;  for  an  FRSPP 
with  a  relatively  large  fractal  exponent,  for  example,  relatively  more  energy  is  concentrated  in 
longer  time  scale  fluctuations  than  for  an  FRSPP  with  a  smaller  fractal  exponent.  Variance 
stems  from  the  inherent  randomness  of  the  strengths  of  these  fluctuations.  A  collection  of 
finite  realizations  of  an  FRSPP  with  the  same  parameters  will  exhibit  fractal  fluctuations  of 
varying  strengths,  leading  to  a  distribution  of  estimated  fractal  exponents. 

Bias  appears  to  arise  from  cutoffs  in  the  time  (frequency)  domain  which  give  rise  to 
oscillations  in  the  frequency  (time)  domain,  confounding  the  pure  power-law  behavior  of  the 
fractal  periodogram  (PG)  and  Allan  factor  (AF).  In  addition,  the  physical  limitations  of 
the  measurement  process  itself  impose  practical  limits  on  the  range  of  time  scales  available. 
Although  algorithms  exist  for  accurately  compensating  for  these  cutoffs,  they  presuppose 
a  detailed  knowledge  of  the  process  a  priori,  which  is  not  in  the  spirit  of  estimating  an 
unknown  signal.  Consequently,  we  have  not  attempted  to  compensate  for  these  cutoffs  in 
this  manner.  In  1995,  we  determined  [3]  the  theoretical  expected  Fano  factor  (FF)  values  for 
an  FRSPP  with  finite  duration,  and  the  corresponding  expected  bias  for  the  corresponding 
fractal  exponent.  The  FF  is  the  ratio  of  the  count  variance  to  the  count  mean,  as  a  function 
of  the  counting  time  T.  Bias  for  the  power  spectral  density  was  also  considered,  but  not  for 
a  finite  data  length. 

The  AF  and  the  PG  highlight  the  fractal  behavior  of  FRSPPs  particularly  well,  and  thus 
prove  to  be  most  useful  for  estimating  fractal  exponents.  We  have  investigated  the  bias  in 


2 


these  measures,  and  the  effects  of  this  bias  on  fractal-exponent  estimation.  The  variance 
of  PG-based  estimators  was  also  examined  in  1995  [3];  that  for  the  AF  appears  not  to  be 
readily  amenable  to  analytical  study. 

2.1  Effects  of  Finite  Data  Length  on  the  AF  Estimate 

Unlike  the  FF,  estimates  of  the  AF  do  not  suffer  from  bias  due  to  finite  data  length;  thus 
fractal-exponent  estimates  based  on  the  AF  do  not  either.  Given  a  particular  data  set,  the 
estimated  AF  A{T)  at  a  particular  counting  time  T  is  given  by 

A{T)  (Zt+i  -  Zi)"  /  2Af-'  Zj,  (1) 

fc=0  /  A:=0 

where  N  is  the  number  of  samples,  {Zk}  represents  the  sequence  of  counts,  and  the  functional 
dependence  of  Zk  upon  T  is  suppressed  for  notational  clarity. 

This  estimate  of  the  AF  is  simply  the  estimate  of  the  Allan  variance  divided  by  twice 
the  estimate  of  the  mean;  however,  computing  the  expected  value  of  this  estimate  is  not 
straightforward.  We  have  therefore  employed  the  true  mean  rather  than  its  estimate  in 
Eq.  (1).  This  does  not  appreciably  affect  the  result,  since  the  error  so  introduced  remains 
a  constant  factor  for  all  counting  times,  and  so  cancels  in  power-law  slope  calculations 
where  logarithms  are  used.  In  any  case,  the  estimate  of  the  Allan  variance  exhibits  far 
larger  variations  than  the  estimate  of  the  mean,  so  the  fluctuations  in  the  AF  estimate  are 
dominated  by  the  former.  Therefore,  the  expected  value  of  the  AF  estimate  becomes 

E[i(r)]  =  E{E[{Zk-Zk+if]/2nZk]} 

«  E  [{Zk-Zk+i)^]/2E[Zk] 

=  e[{Zo-Zi)^]/2E[Zo] 

=  (Ar)-'E[z2-ZoZi],  (2) 

which  is  independent  of  the  number  of  samples,  N,  and  therefore  of  the  duration  of  the 
recording  L.  In  the  limit  L  oo,  the  expected  estimated  AF  for  an  FRSPP  with  0  <  o:  <  3 
follows  the  generally  expected  form  for  an  ergodic  process.  Since  Eq.  (2)  does  not  depend 
on  L,  the  quantity  E  [A(r)  must  assume  a  constant  value  independent  of  L;  thus  the  AF 
does  not  exhibit  bias  caused  by  finite  data  duration.  Finally,  since  the  expected  value  of  the 
AF  estimate  is  unbiased,  the  expected  value  of  the  estimate  of  a  itself  is  expected  to  have 
negligible  bias.  This  is  a  simple  and  important  result. 


Estimates  of  the  ordinary  variance  and  Fano  factor,  in  contrast,  do  depend  on  the  dura- 


tion.  In  this  case  we  have 


Varl'z-]  =  (N 

fc=0 


N-\  (  N-\  y 

A;=0  \  1=0  / 


=  (^-1)“' 


7V-1 


N-lN-l 


N-lN-lN-l 


Y,  zl  -  2N-'  Y.  E  ZtZ,  +  Af-"  E  E  E 

Lfc=0  A:=0  /=0  fc=0  1=0  m=0 

N-1  N-1 N-1 

(N  -  1)-'  ^  Z|  -  N-'{N  -  !)-■  Y  Y  ZtZi 

k=0  k=0  2=0 

Af-VE  zl  -  N-'{N  -  i)-'YT,z:kZ,. 

fc=0  k  l^k 


(3) 


These  cross  terms,  which  do  depend  on  the  number  of  samples,  lead  to  an  estimated  Fano 
factor  with  a  confounding  linear  term 

E  [F(T)j  «  1  +  {T/ToT  -  T /{T^Ly  (4) 

for  0  <  q;  <  1  [3].  The  last  term  on  the  right-hand-side  of  Eq.  (4)  leads  to  bias  in  estimating 
the  fractal  exponent;  for  this  and  other  reasons,  we  do  not  employ  the  FF  in  fractal-exponent 
estimation. 


2.2  Effects  of  Finite  Data  Length  on  the  PSD  Estimate 


Computation  of  the  periodogram  (estimated  power  spectral  density,  PSD)  proves  tractable 
only  when  obtained  from  the  series  of  counts  {Z^},  rather  than  from  the  entire  point  process 
N{t).  This,  and  more  importantly  the  finite  length  of  the  data  set,  introduce  a  bias  in  the 
estimated  fractal  exponent  as  shown  below. 


We  begin  by  obtaining  the  discrete- time  Fourier  transform  of  the  series  of  counts  {Zk}, 
where  0  <  fc  <  M: 

Zn=Yl  .  (5) 

A;=0 

The  periodogram  then  becomes 


-  |2 


Sz{n)  = 

=  E  E 


A:=0  771=0 
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(6) 


with  an  expected  value 


M-l  A/-1 


E[52(n)]  =  M-i  ^  ^ 

A:=0  m=0 

M-l  M-l  r  rT  rT 

=  E  E  /  /  diV(s  +  kT)dN(t  +  mT) 

*^5=0  Jt=0 


k=:0  m=0 
M-l  M-l 


E  E  f  f  Gn[s  -t  +  {k-  m)T]  ds  dt 

75=0  yt=0 


k=0  m=0 
M-l  M-l 


J.y^  ^  J.VJ.  J.  r'ZT _ [itl 

=  M-^Y.Y.  /  /  Giv[«  +  (A:  -  m)T] 

fc=0  m=0  ^=-rA=[u| 


M-l  M-l 


=  M 


E  E  f  (T  -  |«|)  Giv[w  +  (it  -  m)T] 

jk=0  m=0  Ju—T 

M-l  M-l  -X 

^  E  E  /  (T  -  !«!) 

fc=0  m=0  Ju=-T 

Ju=—oo  2,7r 


dudv 

2 

du 


fOO 

=  (27rM)-^  /  5Ar(a;) 

J<jJ=—O0 


M-l 


gjfe(27rn/M+a;T) 


fc=0 


r  iT-\u\)e^^'^dudu 

Ju=-T 


=  (2nM)-'r  S^(u,)  «i°^"  +  ^r/2)  4sin^(^r/2)  ^ 

Jw=-oo  ^  sm^{TTn/M  +  ujT/2)  u? 


=  JL  r  q  /o-  /^N  sin  (a;) 

ttM  J-oo  ^  siv?{x  + 'Kn/M) 


(7) 


For  a  general  fractal  stochastic  point  process,  where  the  PSD  follows  its  usual  power-law 
form,  we  therefore  have 

E  [5^(")]  =  ^  /“  [l  +  (-oT/2)«|x|-“]  dx.  (8) 

L  J  ttM  V-ooL  J  x^sin^(a;4-7rn/M)  ^  ’ 


Focusing  on  the  smaller  values  of  n  useful  in  estimating  fractal  exponents  permits  the  use  of 
two  approximations  in  Eq.  (8).  For  the  values  of  a  of  interest  (0  <  a  <  2),  the  integrand  of 
Eq.  (8)  will  only  be  significant  near  x  =  —Tm/M,  yielding 


r  [l  +  (u,oT/2)“|ir‘*l  + 

7-00  L  -I  X 

'.v?{'Knlh 

{Ttn/My 


=  AT[l  +  (2Wa..Mr)-]^^g^ 
Ri  AT  [l  -h  (27rn/a;oMr)-“]  , 


(9) 


5 


which  is  of  the  expected  form.  Improvement  of  this  estimation  procedure  appears  to  re¬ 
quire  numerical  integration  of  Eq.  (8),  which  proves  nontrivial  since  the  integrand  exhibits 
oscillations  with  a  small  period  tt/M.  Fortuitously,  for  the  parameter  values  of  general  in¬ 
terest  in  our  considerations  the  integrand  appears  peaked  near  x  =  —im/M,  so  that  not  too 
mSiiiy  200)  oscillations  need  be  included  in  the  calculations.  Indeed,  numerical  results 
employing  this  method,  and  with  Wq  0  for  which  Eq.  (8)  is  known  to  assume  the  simple 
value  AT,  agree  within  0.1%.  These  results  form  a  continuation  of  earlier  efforts  [2,  3]  which 
ignored  the  effects  of  imposing  periodic  boundary  conditions  on  the  Fourier  transform,  and 
of  binning  the  events. 

Other  methods  exist  for  compensating  for  finite  data  length  in  power  spectral  estimation, 
such  as  maximizing  the  entropy  subject  to  the  correlation  function  over  the  available  range 
of  times  (see,  e.g.,  [5]). 


3  SUMMARY 


We  have  investigated  the  properties  of  fractal  and  fractal-rate  stochastic  point  processes 
(FSPPs  and  FRSPPs),  focusing  on  the  estimation  of  measures  that  reveal  their  fractal  ex¬ 
ponents.  The  fractal-Gaussian-noise  driven  integrate-and-fire  process  (FGNIF)  is  unique  as 
a  point  process  in  that  it  exhibits  no  short-term  randomness;  we  have  developed  a  gener¬ 
alization  which  includes  jitter,  the  FGNJIF,  for  which  the  short-term  randomness  is  fully 
adjustable.  In  addition  to  the  randomness  contributed  by  the  fractal  nature  of  the  rate,  all 
other  FRSPPs  appear  to  exhibit  additional  randomness  associated  with  point  generation, 
which  confounds  the  accuracy  of  fractal-exponent  estimation.  The  FGNJIF  proved  crucial 
in  elucidating  the  role  that  such  randomness  plays  in  the  estimation  of  fractal  exponents 
in  other  FRSPPs.  We  obtained  analytical  results  for  the  expected  biases  of  the  PG-  and 
AF-based  fractional  exponent  estimators  due  to  finite  data  length.  We  followed  this  theoret¬ 
ical  work  with  a  series  of  simulations  of  FRSPPs  for  three  representative  fractal  exponents: 
a  —  0.2,  0.8,  and  1.5  [4].  Using  these  simulations  together  with  the  analytical  predictions, 
we  delineated  the  sources  of  error  involved  in  estimating  fractal  exponents.  In  particular, 
using  the  FGNJIF  we  were  able  to  separate  those  factors  intrinsic  to  estimation  over  finite 
FRSPP  data  sets  from  those  due  to  the  particular  form  of  FRSPP  involved.  We  conclude 
that  the  AF-based  estimate  proves  more  reliable  in  estimating  the  fractal  exponent  than  the 
PG-based  method,  yielding  rms  errors  of  0.06  for  data  segments  of  FRSPPs  with  10®  points 
over  all  values  of  a  examined.  Finally,  we  note  that  wavelet  generalizations  of  the  AF  appear 
to  yield  comparable  results  [6,  7],  suggesting  that  the  AF  estimate  may  be  optimal  in  some 
applications. 
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